Biometrics authentication system

ABSTRACT

A biometrics authentication system having a small and simple configuration and being capable of implementing both of biometrics authentication and position detection is provided. A biometrics authentication system includes: a light source emitting light to an object; a microlens array section condensing light from the object; a light-sensing device obtaining light detection data of the object on the basis of the light condensed by the microlens array section; a position detection section detecting the position of the object on the basis of the light detection data obtained in the light-sensing device; and an authentication section, in the case where the object is a living body, performing authentication of the living body on the basis of the light detection data obtained in the light-sensing device.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a biometric authentication system usinga light-sensing device.

2. Description of the Related Art

In related arts, image pickup apparatuses picking up an image of astructure in a living body part are used in biometrics authenticationsystems or the like. Typically, as such an image pickup apparatus has alarge thickness, the image pickup apparatus is arranged outside anapparatus to which the image pickup apparatus is applied, or an opticalsystem and a detection system are independently arranged as described inJapanese Unexamined Patent Application Publication Nos. 2005-312748 and2006-181296. However, in recent years, according to a reduction in sizesor profiles of various apparatuses, constraints of manufacturability ordesign, or the like, a reduction in the size and profile of theabove-described biometrics authentication system is desired, and it isdesired to mount the biometric authentication system in an apparatus.

Therefore, as described in, for example, Japanese Unexamined PatentApplication Publication No. 2005-323892, a finger vein authenticationsystem in which authentication of a living body is performed through theuse of a finger vein pattern is proposed as a small module. In thefinger vein authentication apparatus in Japanese Unexamined PatentApplication Publication No. 2005-323892, light sources emittingnear-infrared light are arranged at both ends of a light-sensing device(an image sensor) to illuminate a finger from below, and thelight-sensing device detects scattered light inside the finger. At thistime, the near-infrared light is absorbed by hemoglobin in veins, so avein pattern is detected by detecting the scattered light. In addition,a fingerprint authentication apparatus using a gradient-index lens arrayto reduce its profile is also proposed as described in, for example,Japanese Unexamined Patent Application Publication No. H10-289304.

SUMMARY OF THE INVENTION

On the other hand, various apparatuses including a touch pad or a touchpanel such as, for example, cellular phones have been put to practicaluse. The touch pad or the touch panel detects the position of afingertip, a pen (a stylus) or the like, thereby inputting through thetouch pad or the touch panel is allowed, and as position detectionmeans, various position sensors such as, for example, apressure-sensitive position sensor and an electrostatic position sensorare used.

Moreover, recently, according to diversification of apparatuses, thedevelopment of multifunctional biometrics authentication systems havinga position detection function by the touch panel or the like is desired.However, when both of the touch panel and the biometrics authenticationsystem are mounted in one apparatus, the whole configuration of theapparatus is complicated and large, and in particular, it is difficultto apply them to a small apparatus such as a cellular phone. Moreover,it is difficult to configure or arrange an illumination means so as tobe used for both of the touch panel and the biometrics authenticationsystem.

It is desirable to provide a biometrics authentication system having asmall and simple configuration and being capable of implementing both ofauthentication of a living body and position detection of an object.

According to an embodiment of the invention, there is provided abiometrics authentication system including: a light source emittinglight to an object; a microlens array section condensing light from theobject; a light-sensing device obtaining light detection data of theobject on the basis of the light condensed by the microlens arraysection; a position detection section detecting the position of theobject on the basis of the light detection data obtained in thelight-sensing device; and an authentication section, in the case wherethe object is a living body, performing authentication of the livingbody on the basis of the light detection data obtained in thelight-sensing device.

In the biometrics authentication system according to the embodiment ofthe invention, light applied from the light source to the object iscondensed by the microlens array section, and then is detected by thelight-sensing device. Thereby, light detection data of the object isobtained. On the basis of the light detection data obtained in such amanner, the position detection section detects the position of theobject, and in the case where the object is a living body, theauthentication section performs authentication of the living body.

In the biometrics authentication system according to the embodiment ofthe invention, light applied from the light source to the object iscondensed by the microlens array section, and then is detected by thelight-sensing device, thereby the light detection data is obtained. Onthe basis of the light detection data, authentication of the living bodyby the authentication section and position detection of the object bythe position detection section are performed, so it is not necessary toseparately arrange various position sensors. Therefore, the biometricsauthentication system with a small and simple configuration mayimplement both of biometrics authentication and position detection.

Other and further objects, features and advantages of the invention willappear more fully from the following description.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an illustration of the whole configuration of a biometricsauthentication system according to a first embodiment of the invention.

FIGS. 2A and 2B are schematic sectional views of the configurations ofmain parts of the biometrics authentication system illustrated in FIG.1.

FIG. 3 is an illustration for describing light detection data obtainedby a light-sensing device illustrated in FIG. 1.

FIGS. 4A to 4C are schematic views of two-dimensional configurations ofthe light detection data obtained by the light-sensing deviceillustrated in FIG. 1.

FIG. 5A is an actually picked-up image of a finger, and FIGS. 5B and 5Care parallax images obtained from FIG. 5A.

FIGS. 6A to 6C are parallax images for describing position detectionoperation in a position detection section illustrated in FIG. 1.

FIG. 7 is a schematic sectional view of the configuration of a main partof a biometrics authentication system according to Modification 1.

FIG. 8 is a schematic sectional view of the configuration of a main partof a biometrics authentication system according to Modification 2.

FIG. 9 is a schematic sectional view of the configuration of a main partof a biometrics authentication system according to Modification 3.

FIG. 10 is a perspective view of the schematic configuration of acellular phone according to Application Example 1.

FIG. 11 is a schematic sectional view of the configuration of a mainpart of a biometrics authentication system according to a secondembodiment of the invention.

FIG. 12 is a perspective view of the schematic configuration of acellular phone according to Application Example 2.

FIG. 13 is an illustration of another usage example of the cellularphone illustrated in FIG. 12.

FIG. 14 is an illustration of the whole configuration of a biometricsauthentication system according to a third embodiment of the invention.

FIG. 15 is a schematic top view of the biometrics authentication systemillustrated in FIG. 14.

FIGS. 16A and 16B are illustrations of the placement of a fingercorresponding to position detection and authentication in the biometricsauthentication system illustrated in FIG. 14.

FIG. 17 is a flowchart of a function determination process and a lightsource output changing process in the biometrics authentication systemillustrated in FIG. 14.

FIG. 18 is a schematic top view of a biometrics authentication systemaccording to Modification 4.

FIGS. 19A and 19B are illustrations of the placement of a fingercorresponding to position detection and authentication in the biometricsauthentication system illustrated in FIG. 18.

FIG. 20 is a flowchart of a function determination process and a lightsource output changing process in the biometrics authentication systemillustrated in FIG. 18.

FIG. 21 is an illustration of the schematic configuration of a cellularphone according to Modification 5.

FIG. 22 is a flowchart of a function switching process and a lightsource output changing process in the cellular phone illustrated in FIG.21.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Preferred embodiments will be described in detail below referring to theaccompanying drawings.

First Embodiment

FIG. 1 illustrates the whole configuration of a biometricsauthentication system (a biometrics authentication system 1) accordingto a first embodiment of the invention. FIG. 2A is a schematic sectionalview of the configuration of a main part of the biometricsauthentication system 1, and FIG. 2B is a schematic view of thebiometrics authentication system 1 viewed from above. The biometricsauthentication system 1 outputs authentication result data Dout1 of aliving body (for example, a fingertip) 2 as an object subjected to imagepickup, and outputs position data Dout2 of the living body 2. Thebiometrics authentication system 1 includes a near-infrared light source10, a cover glass 11, a microlens array 12, a light-sensing device 13,an image processing section 14, an authentication section 15, a positiondetection section 16, a light source driving section 181, alight-sensing device driving section 182 and a control section 19.

The near-infrared light source 10 is a light source applying light in anear-infrared region (hereinafter simply referred to as near-infraredlight) to the living body 2 as the object subjected to image pickup. Forexample, as illustrated in FIG. 2B, a plurality of (three for each sidein FIG. 2B) near-infrared light sources 10 are arranged along twoopposed sides in a Y-axis direction of a rectangular image pickup regionS in which the cover glass 11, the microlens array 12 and thelight-sensing device 13 are arranged. The near-infrared light sources 10each are made of, for example, an LED (Light Emitting Diode) or thelike. In addition, the near-infrared light is, for example, light in awavelength region of approximately 700 nm to 1200 nm. In the case wherelight in such a wavelength region is used, when vein authentication ofthe living body 2 is performed, light use efficiency may be furtherimproved by a balance between the transmittance through the living body2 and the absorption into reduced hemoglobin (veins) in the living body2.

The cover glass 11 protects the interior of the biometricsauthentication system 1, and is a section which is a contact point withthe living body 2.

The microlens array 12 includes a plurality of microlenses arranged in amatrix form, and is arranged below the cover glass 11. Each microlensfunctions as an image pickup lens for the living body 2 as the objectsubjected to image pickup.

The light-sensing device 13 obtains light detection data on the basis oflight condensed by each microlens of the microlens array 12. Thelight-sensing device 13 is arranged on a focal plane of the microlensarray 12, and a plurality of pixels are allocated to one microlens. Thelight-sensing device 13 includes, for example, a plurality oflight-sensing pixels such as a plurality of CCDs (Charge CoupledDevices) arranged in a matrix form. In the embodiment, the light-sensingdevice 13 is arranged all over the image pickup region S.

The image processing section 14 performs predetermined image processingon the light detection data obtained in the light-sensing device 13 inresponse to the control of the control section 19 to produce imageprocessing data of the living body 2, and then output the imageprocessing data to the authentication section 15 and the positiondetection section 16. In addition, the image processing data outputtedto the authentication section 15 and the image processing data outputtedto the position detection section 16 may be the same as or differentfrom each other. Moreover, the image processing section 14, and theauthentication section 15, the position detection section 16 and thecontrol section 19 all of which will be described later each include,for example, a microcomputer or the like.

The authentication section 15 performs authentication (veinauthentication in the embodiment) of the living body 2 by comparing animage processing data pattern inputted from the image processing section14 to a biometrics authentication pattern stored in a pattern storingsection (not illustrated) in response to the control of the controlsection 19. The pattern storing section is a section storing a biometricauthentication pattern obtained by picking up an image of the livingbody 2 in advance, and includes a nonvolatile memory device (forexample, an EEPROM (Electrically Erasable Programmable Read Only Memory)or the like). A result obtained by the authentication section 15 isoutputted to outside as authentication result data Dout1.

The position detection section 16 detects the position (x, y, z) of theliving body 2 on the basis of the image processing data inputted fromthe image processing section 14 in response to the control of thecontrol section 19. Position information detected by the positiondetection section 16 is outputted to outside as position data Dout2.

The light source driving section 181 drives the near-infrared lightsources 10 to emit light in response to the control of the controlsection 19. The light-sensing device driving section 182 drives thelight-sensing device 13 to pick up an image (to detect light) inresponse to the control of the control section 19.

The control section 19 controls the operations of the image processingsection 14, the authentication section 15, the light source drivingsection 181 and the light-sensing device driving section 182 asappropriate.

Next, functions and effects of the above-described biometricsauthentication system 1 will be described below.

In the biometrics authentication system 1, when the living body (forexample, a fingertip) 2 comes into contact with or comes close to thecover glass 11, the near-infrared light sources 10 are driven by thelight source driving section 181 to emit light Lout. The light appliedto the living body 2 is condensed by the microlens array 12, and thendetected in the light-sensing device 13. Thereby, in the light-sensingdevice 13, the light detection data of the living body 2 is obtained,and the light detection data is outputted to the image processingsection 14.

Now, referring to FIG. 3 to FIGS. 4A to 4C, specific operation of theimage processing section 14 will be described below. FIG. 3schematically illustrates an optical path reaching the light-sensingdevice 13 from the living body 2. FIG. 4A schematically illustrates atwo-dimensional configuration of light detection data D0 obtained in thelight-sensing device 13. FIGS. 4B and 4C schematically illustratetwo-dimensional configurations of parallax image data DL and DR producedon the basis of the light detection data D0, respectively.

In the image processing section 14, two right and left parallax imagesare produced on the basis of inputted light detection data. In thiscase, as illustrated in FIG. 3, in the above-described light-sensingdevice 13, a light-sensing region 12D for each microlens is formed, andeach light ray keeping information on the traveling direction thereof isdetected. Moreover, pixel data in pixels arranged at the same positionin the light-sensing regions 12D include information on the sametraveling direction. The image processing section 14 produces parallaximages of at least two light rays, for example, incident light rays LLand LR from the left and right direction with respect to an optical axisZ of light rays received in the light-sensing regions 12D.

More specifically, first, in the light detection data D0, pixel data P1in pixels where the light ray LL is received (in FIG. 4A, pixel data inpixels at the same position (black parts) in the light-sensing regions12D) are extracted from the light-sensing regions 12D, and then theseextracted pixel data P1 are synthesized (refer to FIG. 4B). Likewise,pixel data P2 (in shaded parts in FIG. 4A) corresponding to the lightray LR are extracted from the light-sensing regions 12D, and then theseextracted pixel data P2 are synthesized (refer to FIG. 4C). Thereby,left and right parallax image data DL and DR are produced. FIG. 5Aillustrates an actually picked-up image, and FIGS. 5B and 5C illustrateparallax images produced from the picked-up image in FIG. 5A.

The parallax image data DL and DR produced in the above-described mannerare subjected to another image processing, for example, a defectcorrection process or a noise reduction process as necessary, and thenthe parallax image data DL and DR are outputted to the authenticationsection 15 and the position detection section 16 as image processingdata.

In the authentication section 15, vein authentication is performed bycomparing a vein pattern on the basis of the inputted image processingdata to an authentication pattern stored in advance. Thereby, abiometrics authentication process is completed, and a result by thebiometrics authentication process is outputted to outside as anauthentication result Dout1.

On the other hand, in the position detection section 16, the position(x, y, z) of the living body 2 is detected on the basis of inputtedimage processing data. For example, the position (x, y) of the livingbody 2 is detected by performing an edge detection process on oneparallax image data of the living body 2. On the other hand, the zcomponent (height) of the living body 2 is specified by, for example,the following technique. A phase difference between living body imagesin two parallax images is calculated on the basis of a correlationbetween the left and right parallax data DL and DR corresponding to theimage processing data, and the position in a z direction (a height H inFIG. 2) of the living body 2 is specified on the basis of the phasedifference. FIGS. 6A to 6C illustrate right and left parallax images inthe case where the height H is 0 mm, 5 mm and 10 mm. As illustrated inFIGS. 6A to 6C, phase differences (Δδ₁, Δδ₂ and Δδ₃) between the phasesof the living body 2 in the right and left parallax images are detectedby, for example, the edge detection process. At this time, as the heightof the living body 2 is reduced, that is, as the living body 2 comescloser to the cover glass 11, the phase difference between the phases ofthe living body 2 in two parallax images is reduced. (Δδ₃>Δδ₂>Δδ₁).Therefore, when the phase difference between the phases of the livingbody 2 in two parallax images is detected on the basis of thecorrelation between the right and left parallax images, the z componentof the living body 2 is specified. Thereby, for example, the case ofZ=0, that is, the case where the living body 2 is in contact with thecover glass 11 is detectable.

Moreover, the movement of the living body 2 in a horizontal plane (an XYplane) is detected as will be described below. For example, a pluralityof parallax image data of the living body 2 are successively produced,and the edge detection process is performed on each of the plurality ofparallax image data to calculate the movement amount of the living body2, thereby the movement of the living body 2 is detected.

Information on the position (x, y, z) of the living body 2 detected inthe position detection section 16 in such a manner is outputted tooutside as position data Dout2.

As described above, in the embodiment, light applied from thenear-infrared light sources 10 to the living body 2 is condensed by themicrolens array 12, and then the light is detected in the light-sensingdevice 13, thereby the light detection data is obtained. The imageprocessing section 14 produces the left and right parallax image data DLand DR on the basis of the obtained light detection data, and outputsthe left and right parallax image data DL and DR to the authenticationsection 15 and the position detection section 16 as image processingdata. On the basis of the image processing data supplied in such amanner, the authentication section 15 performs authentication of theliving body 2 and the position detection section 16 detects the positionof the living body 2. In other words, authentication by theauthentication section 15 and position detection by the positiondetection section 16 are performed by shared light sources and a shareddetection optical system (the microlens array 12 and the light-sensingdevice 13), so both of a biometrics authentication function and aposition detection function are implemented without separatelyarranging, for example, a position sensor such as a pressure-sensitivesensor or an electrostatic sensor. Therefore, the biometricsauthentication system 1 is allowed to implement both of biometricsauthentication and position detection with a small and simpleconfiguration. Moreover, in particular, an illumination means is usedfor both of biometrics authentication and position detection, so a costreduction is achieved.

Further, when authentication is performed through the use of veins of aliving body, a higher level of security is obtained, compared to thecase where a fingerprint is used, because veins are a structure inside afinger, so veins are resistant to change due to aging, injury or thelike, and are resistant to forgery.

Typically, to obtain a vein pattern necessary for authentication, it isnecessary to secure a large image pickup area, for example, an area ofapproximately 30 mm×15 mm, compared to the case where a fingerprintpattern is used. Therefore, in the case where a biometricsauthentication system using veins is arranged together with a touchpanel or a touch pad, it is necessary to secure an image pickup spacefor the above-described vein authentication in addition to a space forthe touch panel or the touch pad, thereby the size of the wholeapparatus is increased.

On the other hand, in the embodiment, the biometrics authenticationsystem 1 has both of the biometrics authentication function and theposition detection function with a small and simple configuration.Therefore, as will be described in detail later, it is not necessary toindependently arrange a space for the touch panel or the like and animage pickup space for biometrics authentication. Therefore, in the casewhere the biometrics authentication system 1 functions as a touch panelor the like while performing vein authentication, an increase in thesize of the whole apparatus is prevented. Therefore, a small biometricsauthentication system with a high level of security is achieved.

Modification 1

FIG. 7 is a schematic sectional view of the configuration of a main partof a biometrics authentication system according to Modification 1 of thefirst embodiment. The biometrics authentication system according to themodification has the same configuration as that of the biometricsauthentication system 1 according to the first embodiment except for theconfigurations of the light source and the light-sensing device.Therefore, like components are denoted by like numerals as of thebiometrics authentication system 1 and will not be further described.

In the modification, a light-sensing device 25 and a backlight 24 arearranged below the microlens array 12. The backlight 24 is a lightsource emitting near-infrared light and light in a visible region(hereinafter simply referred to as visible light), for example, whitelight, and includes, for example, a plurality of CCFLs (Cold CathodeFluorescent Lamps) or LEDs arranged. The light-sensing device 25 isarranged on the focal plane of the microlens array 12 as in the case ofthe above-described light-sensing device 13, and includes CCDs or thelike. A light-shielding section 25-1 for preventing the entry of straylight into the light-sensing device 25 is arranged between thelight-sensing device 25 and the microlens array 12. However, in themodification, the light-sensing device 25 is arranged only in a partialregion (a light-sensing region 25A) of a transparent substrate 250, anda region where the light-sensing device 25 is not arranged is atransmission region 25B allowing light from the backlight 24 to passtherethrough upward.

In such a configuration, light L1 emitted from the backlight 24 passesthrough the transmission region 25B of the transparent substrate 250 tobe emitted to above the cover glass 11. When the living body 2 isirradiated with the light L1, the light L1 is condensed by the microlensarray 12, and then is detected in the light-sensing device 25. Thereby,the light detection data of the living body 2 is obtained, and as in thecase of the above-described biometrics authentication system 1, on thebasis of the light detection data, the authentication section 15performs authentication of the living body 2, and the position detectionsection 16 detects the position of the living body 2. Therefore, thesame effects as those in the above-described biometrics authenticationsystem 1 are obtained.

As described above, the shape or arrangement of the light source forapplying light to the living body 2 is not specifically limited.Moreover, in the above-described embodiment and the modification, as thelight source, the near-infrared light sources 10 and the backlight 24emitting white light and near-infrared light are described as examples,but the configuration of the light source is not limited thereto. Forexample, in the case where authentication using a fingerprint isperformed as biometrics authentication, a light source emitting at leastvisible light may be used.

In addition, the number of the light-sensing regions 25A on thetransparent substrate 250, or the area, shape or the like of thelight-sensing region 25A is not specifically limited. Moreover, onelight-sensing region 25A may include one pixel or a plurality of pixels.Further, in the light-sensing region 25A, the number of pixels allocatedto each microlens is not specifically limited. However, to produce tworight and left parallax image data in the image processing section 14,at least 2 pixels are allocated to one microlens.

Modification 2

FIG. 8 is a schematic sectional view of the configuration of a main partof a biometrics authentication system according to Modification 2 of thefirst embodiment. The biometrics authentication system according to themodification has the same configuration as those of the first embodimentand Modification 1, except that both of the near-infrared light sources10 used in the first embodiment and the backlight 24 used inModification 1 are arranged. However, the near-infrared light sources 10function as light sources for biometrics authentication, and thebacklight 24 functions as a light source for position detection.

Thereby, in biometrics authentication, near-infrared light from thenear-infrared light sources 10 is used to produce light detection datafor authentication, and in position detection, light from the backlight24 is used to produce light detection data for position detection. Thelight detection data for biometrics authentication or position detectionproduced in such a manner is supplied to the image processing section 14in the first embodiment. In the image processing section 14, the rightand left parallax image data DR and DL are produced by the sametechnique as that described above. Then, the produced parallax imagedata DR and DL are supplied to the authentication section 15 or theposition detection section 16, and biometrics authentication or positiondetection is performed by the same technique as that described above.

As described above, light sources for biometrics authentication andposition detection may be separately arranged as light sources forapplying light to the living body 2. In this case, the light sources areseparately arranged, but biometrics authentication and positiondetection are performed by a shared detection optical system (themicrolens array 12 and the light-sensing device 25), so effectssubstantially equivalent to the above-described effects are obtained.

Modification 3

FIG. 9 is a schematic view of a biometrics authentication systemaccording to Modification 3 of the first embodiment viewed from above(from the cover glass 11 side). The biometrics authentication systemaccording to Modification 3 has the same configuration as that of thebiometrics authentication system according to the first embodimentexcept for the configurations of the light sources. In the modification,a plurality of (three for each side in the modification) near-infraredlight sources 10 for biometrics authentication are arranged along twoopposed sides in a Y-axis direction of four sides of the rectangularimage pickup region S, and a plurality of (three for each side in themodification) of visible light sources 28 for position detection arearranged two opposed sides in an X-axis direction. The visible lightsources 28 each are made of, for example, an LED emitting visible lightor the like. In such a configuration, as in the case of Modification 2,in the light-sensing device 13, in biometrics authentication,near-infrared light is applied to the living body 2 to obtain lightdetection data for authentication, and in position detection, visiblelight is applied to the living body 2 to obtain light detection data forposition detection.

As described above, the near-infrared light sources 10 for biometricsauthentication and the visible light sources 28 for position detectionmay be arranged on a common plane above the biometrics authenticationsystem. Thereby, effects substantially equivalent to those of thebiometrics authentication system 1 according to the first embodiment areobtained.

In addition, in the modification, as the light sources for positiondetection, the visible light sources 28 emitting visible light are used,but the light sources for position detection are not limited thereto,and light sources emitting near-infrared light may be used.

Application Example 1

FIG. 10 illustrates a schematic configuration of a cellular phone 3according to Application Example 1 of the first embodiment. The cellularphone 3 includes a flip-type enclosure (a first enclosure 20 and asecond enclosure 21), and a display panel 22 for displaying an image isarranged in the first enclosure 20. On the other hand, in the secondenclosure 21, an operation section 23 for performing input operation andthe above-described biometrics authentication system 1 are arranged.However, the biometrics authentication system 1 is mounted in thecellular phone 3 so that the top surface (the cover glass 11) thereof isexposed to a surface of the second enclosure 21.

In the application example, as the biometrics authentication system 1 ismounted in the cellular phone 3, the biometrics authentication system 1functions as, for example, a touch pad from which the input operation isperformed in response to the position (including movement) of afingertip of a user. More specifically, when contact by the fingertip(z=0) is detected, input by click operation is allowed. Moreover, whenthe frequency of occurrences of contact by the fingertip in a certainperiod is measured, input by double-click operation is allowed. Further,when the movement of the fingertip, that is, a change in the position(x, y) is detected, the biometrics authentication system 1 may functionas a mouse pointer.

Moreover, function input for executing log-in, password substitution,settlement or the like may be performed. In other words, the biometricsauthentication system 1 allows finger identification to be performed, sowhen a program for executing the above-described specific process inresponse to, for example, the order of fingers to be detected is set inadvance, the function input is allowed. For example, a program forexecuting a process such as “open address book” when the right indexfinger and the right middle finger of a user is detected in this ordermay be set.

In addition, an apparatus to which the biometrics authentication system1 is applied is not limited to the above-described cellular phone, andthe biometrics authentication system 1 is applicable to, for example,various mobile devices such as a notebook type PC (Personal Computer).

Second Embodiment

FIG. 11 is a schematic sectional view of the configuration of a mainpart of a biometrics authentication system (a biometrics authenticationsystem 4) according to a second embodiment of the invention. Thebiometrics authentication system 4 has an image display function inaddition to the biometrics authentication function and the positiondetection function in the above-described biometrics authenticationsystem 1. Therefore, like components are denoted by like numerals as ofthe biometrics authentication systems in the first embodiment and theabove-described modifications and will not be further described.

In the biometrics authentication system 4, a display section 30 and alight-sensing section 31 are arranged in a common plane below themicrolens array 12. The light-shielding section 25-1 for preventing theentry of stray light or the like into a light-sensing section 31 isarranged between the light-sensing section 31 and the microlens array12. The light-sensing section 31 includes, for example, a plurality oflight-sensing pixels arranged, and has the same function as that of theabove-described light-sensing device 13. The backlight 24 is arrangedbelow the light-sensing section 31 and the display section 30.

The display section 30 is a display device for displaying an image suchas a graphic form, a character or the like, and is configured of an LCD(a liquid crystal display) in which a plurality of display pixels arearranged in a matrix form. The display section 30 includes a liquidcrystal cell 302, a pair of polarizers 301 and 302 and a color filter304. The display section 30 modulates light emitted from the backlight24 to emit display light L2 toward above the cover glass 11. The displaylight L2 includes visible light and near-infrared light.

The liquid crystal cell 302 includes a pair of transparent substrates(not illustrated) and a liquid crystal layer (not illustrated) arrangedbetween the pair of transparent substrates. The liquid crystal cell 302modulates incident light from the backlight 24 in response to a voltageapplied between the transparent substrates on the basis of image data.

The polarizer 301 is arranged in a region corresponding to the liquidcrystal cell 302 between the backlight 24 and the liquid crystal cell302. The polarizer 303 is arranged in a region corresponding to theliquid crystal cell 302 between the liquid crystal cell 302 and themicrolens array 12.

The color filter 304 selectively allows light in a wavelength regioncorresponding to its own emission color (for example, red light, greenlight or blue light) and light in an invisible light region (forexample, near-infrared light) of light from the backlight 24 havingpassed through the liquid crystal cell 302 and the polarizer 303 to passtherethrough.

Next, functions and effects of the above-described biometricsauthentication system 4 will be described below.

In the biometrics authentication system 4, on the basis of light fromthe backlight 24, the display section 30 produces display light L2(including the visible light and near-infrared light) for displaying animage to emit the display light L2 toward above the cover glass 11. Atthis time, for example, when the living body 2 such as a finger comesinto contact with or comes close to the cover glass 11, the displaylight L2 is applied to the living body 2. The light applied to theliving body 2 is condensed by the microlens array 12, and then isdetected by the light-sensing section 31. Thereby, light detection dataof the living body 2 is obtained. On the basis of the light detectiondata obtained in such a manner, as in the case of the first embodiment,the image processing section 14 produces image processing data (parallaximage data DL and DR), and on the basis of the image processing data, inthe authentication section 15 or the position detection section 16,biometrics authentication or position detection is performed. Therefore,all of biometrics authentication, position detection and image displayare implemented.

Application Example 2

FIG. 12 illustrates the schematic configuration of a cellular phone 5according to Application Example 2 of the second embodiment. Thecellular phone 5 includes a flip-type enclosure (a first enclosure 40and a second enclosure 41), and the above-described biometricsauthentication system 4 is arranged in the first enclosure 40, and anoperation section 42 for performing input operation is arranged in thesecond enclosure 41. However, the biometrics authentication system 4 ismounted in the cellular phone 5 so that the top surface (the cover glass11) thereof is exposed to a surface of the first enclosure 40.

In the application example, as the biometrics authentication system 4 ismounted in the cellular phone 5, input operation is performed inresponse to the position of a fingertip of a user while displaying animage on the cover glass 11. In other words, the biometricsauthentication system 4 also functions as a touch panel. For example,the same technique as that of the touch pad in Application Example 1 ofthe first embodiment is used to allow input by click operation,double-click operation, mouse pointer operation or the like associatedwith contents to be displayed, a position where an image is displayed,or the like.

An object of which the position is to be detected is not limited to theliving body 2, and may be any other object, for example, a stylus 6 asillustrated in FIG. 13. Also in this case, right and left parallax imagedata are produced by image processing by the above-described imageprocessing section 14, and a phase difference between the parallax imagedata is detected, thereby the position (x, y, z) of the stylus 6 isdetected. Thereby, input using the stylus 6 is allowed.

Third Embodiment

FIG. 14 illustrates the whole configuration of a biometricsauthentication system (a biometrics authentication system 7) accordingto a third embodiment of the invention. FIG. 15 is a schematic view ofthe biometrics authentication system 7 viewed from above. The biometricsauthentication system 7 performs authentication of the living body 2 orposition detection of the living body 2 as in the case of the biometricsauthentication system 1 according to the first embodiment, and isapplied to a touch pad. However, the biometrics authentication system 7automatically (more specifically, depending on the placement of afinger) determines which one between an authentication function forauthentication of the living body 2 and a position detection function ofthe living body 2 to be executed, and then switches between thefunctions.

As in the case of the biometrics authentication system 1 according tothe first embodiment, the biometrics authentication system 7 includesthe cover glass 11, the microlens array 12, the light-sensing device 13,the image processing section 14, the authentication section 15, theposition detection section 16, the light source driving section 181, thelight-sensing device driving section 182 and the control section 19.Light sources 50 for applying light to the living body 2 are arranged onboth sides of the image pickup region S. Therefore, like components aredenoted by like numerals as of the biometrics authentication system 1according to the first embodiment and will not be further described.

The light sources 50 each include, for example, a plurality of LEDsarranged, and may be near-infrared light sources or visible lightsources emitting white light or the like. In the case where biometricsauthentication is performed through the use of veins, near-infraredlight sources are preferably used, and in the case where biometricsauthentication is performed through the use of fingerprints, visiblelight sources are preferably used.

As in the case of the first embodiment, the light source driving section181 drives the light sources 50 to emit light. However, in theembodiment, the light source driving section 181 drives the lightsources 50 in response to the control (a control signal DL) of thecontrol section 19 so that the light emission amounts (light sourceoutputs) of the light sources 50 are changeable. More specifically, thelight source driving section 181 performs switching between a lightsource output (a light amount a1) for position detection and a lightsource output (a light amount a2) for authentication depending on afunction to be executed. The light amount a1 for position detection is anecessary and sufficient light amount for detecting the position of theliving body 2, and the light amount a2 for authentication is a lightamount by which a vein pattern of the living body 2 is obtainable. Inthis case, in position detection, it is only necessary to apply light tothe surface of the living body 2 to highlight the outside shape of theliving body 2 to an extent distinguishable from other regions, so thelight amount a1 is relatively small. On the other hand, inauthentication, it is necessary to irradiate the inside of the livingbody 2 with light to capture the shapes of veins, so the light amount a2is relatively large (a1<a2).

As described in the first embodiment, the light-sensing device drivingsection 182 drives the light-sensing device 13 to pick up an image (todetect light). However, in the embodiment, the light-sensing devicedriving section 182 drives the light-sensing device 13 to selectivelyretrieve pixel data in a specific region, for example, regions Sa, Sband Sc in the light-sensing device 13 (in the image pickup region S).

The regions Sa, Sb and Sc are arranged in both end parts and a centralpart in a longitudinal direction of the rectangular image pickup regionS. The number of the specific regions, and the areas, positions and thelike of the specific regions are not specifically limited, but as in thecase of the regions Sa, Sb and Sc, a plurality of specific regions arepreferably arranged along a longitudinal direction in the image pickupregion S, because as will be described later, which one between theposition detection function and the authentication function to beexecuted is determined depending on the placement of a finger in theimage pickup region S.

As described in the first embodiment, the image processing section 14performs predetermined image processing on light detection data.However, in the embodiment, the image processing section 14 performspredetermined arithmetic processing on the basis of each of the pixeldata of the region Sa, Sb and Sc in the image pickup region S, anddetermines which one between the position detection function and theauthentication function to be executed on the basis of an arithmeticresult obtained by the arithmetic processing. A function determinationresult (determination result data D_(M)) by the image processing section14 is outputted to the control section 19. In this case, the imageprocessing section 14 includes “a function determination section” in theinvention.

As described in the first embodiment, the control section 19 controlsthe operations of the image processing section 14, the authenticationsection 15, the light source driving section 181 and the light-sensingdevice driving section 182 as appropriate. However, in the embodiment,the control section 19 selectively controls the authentication section15 or the position detection section 16 on the basis of thedetermination result data D_(M) inputted from the image processingsection 14, and controls the light source driving section 181 so as tochange the outputs of the light sources 50.

Next, functions and effects of the embodiment will be described belowreferring to FIGS. 14 to 17.

In the embodiment, as in the case of the first embodiment, light appliedto the living body 2 is condensed by the microlens array 12, and then isdetected in the light-sensing device 13. Thereby, the light detectiondata of the living body 2 is obtained in the light-sensing device 13,and the obtained light detection data is outputted to the imageprocessing section 14. The image processing section 14 performs theabove-described image processing on the light detection data to produceimage processing data, and the image processing data is outputted to theauthentication section 15 or the position detection section 16. Thereby,the authentication section 15 performs authentication of the living body2, and the position detection section 16 performs position detection ofthe living body 2.

However, in the embodiment, the image processing section 14 determineswhich one between the authentication function or the position detectionfunction to be executed, before producing the above-described imageprocessing data. Then, on the basis of the determination result, thecontrol section 19 executes the authentication function or the positiondetection function, and on the basis of the function to be executed, thelight source driving section 181 drives the light sources 50 so as tochange their output. Such a function determination process and such alight source output changing process will be described below.

FIG. 16A schematically illustrates the placement of the living body 2when executing the position detection function, and FIG. 16Bschematically illustrates the placement of the living body 2 whenexecuting the authentication function. When the living body 2 is placedso that the longitudinal direction of the rectangular image pickupregion S and the longitudinal direction of the living body 2 (a finger)intersect with each other, the image processing section 14 determines toexecute the position detection function. On the other hand, when thelongitudinal direction of the living body 2 (the finger) is placed alongthe longitudinal direction of the rectangular image pickup region S, theimage processing section 14 determines to execute the authenticationfunction.

More specifically, as will be described below, function determination isperformed, and the light source outputs are changed. That is, asillustrated in FIG. 17, first, the light source driving section 181turns the light sources 50 on (step S11). At this time, the lightemission amount of the light sources 50 is the light amount a1 forposition detection of the living body 2. When the light sources 50illuminate, the light-sensing device 13 obtains pixel data in thespecific regions Sa, Sb and Sc in the image pickup region S in responseto the drive control of the light-sensing device driving section 182.Each of the obtained pixel data is outputted to the image processingsection 14.

The image processing section 14 calculates the average value (a pixelvalue Ra, Rb or Rc) of the pixel data in each of the regions Sa, Sb andSc, and compares the average values to a predetermined threshold value I(step S12). As a result, in the case where all of the pixel values Ra,Rb and Rc are equal to or larger than the threshold value I (step S12:Y), the living body 2 is considered to be placed as illustrated in FIG.16B, thereby the image processing section 14 determines to execute theauthentication function. On the other hand, in the case where one ormore of the pixel values Ra, Rb and Rc are smaller than the thresholdvalue I (step S12: N), the living body 2 is considered to be placed asillustrated in FIG. 16A, the image processing section 14 determines toexecute the position detection function. These determination results areoutputted to the control section 19 as the determination result dataD_(M).

In the case where the image processing section 14 determines to executethe authentication function, the light source driving section 181 drivesthe light sources 50 in response to the control of the control section19 to change the outputs of the light sources 50 from the light amounta1 for position detection to the light amount a2 for authentication(step S13). Moreover, the light-sensing device driving section 182drives the light-sensing device 13 to obtain the light detection data.The image processing section 14 performs the above-described imageprocessing on the light detection data on the basis of the light amounta2 to produce image processing data D1 on the basis of the light amounta2, and then outputs the image processing data D1 to the authenticationsection 15. The authentication section 15 compares the inputted imageprocessing data D1 to the predetermined authentication pattern. At thistime, the authentication section 15 determines whether or notauthentication is executable on the basis of the image processing dataD1 (step S14), and the outputs of the light sources 50 are maintained atthe light amount a2 until authentication is properly completed (stepS14: Y). In the case where authentication is properly completed (stepS14: N), authentication operation in the authentication section 15 isterminated, and then the procedure in the biometrics authenticationsystem 7 goes back to the step S11. The authentication result isoutputted to outside as authentication result Dout1.

In the case where the image processing section 14 determines to executethe position detection function, light detection data is obtained whilemaintaining the outputs (the light amount a1) of the light sources 50.The image processing section 14 performs the above-described imageprocessing on the light detection data on the basis of the light amounta1 to produce image processing data D2 on the basis of the light amounta1, and then outputs the image processing data D2 to the positiondetection section 16. The position detection section 16 detects theposition (x, y, z) of the living body 2 by the same technique as that inthe first embodiment on the basis of the inputted image processing dataD2. Next, the pixel values Ra, Rb and Rc in the regions Sa, Sb and Scare calculated to determine whether or not the pixel values Ra, Rb andRc are changed in a certain period (step S15), and when the pixel valuesRa, Rb and Rc are changed (step S15: N), the procedure goes back to thestep S11. In the case where the pixel values Ra, Rb and Rc are notchanged (step S15: Y), the light source driving section 181 turns thelight sources 50 off to complete the position detection process.Information on the position (x, y, z) is outputted to outside asposition data Dout2.

As described in the embodiment, the light detection data is obtained onthe basis of light applied from the light sources 50 to the living body2, and the image processing section 14 performs the predetermined imageprocessing on the light detection data to produce image processing dataD1 and D2. The produced image processing data D1 and D2 are outputted tothe authentication section 15 and the position detection section 16,thereby the authentication section 15 performs authentication of theliving body 2, and the position detection section 16 detects theposition of the living body 2. Therefore, the same effects as those inthe first embodiment are obtained.

Moreover, in the embodiment, the specific regions Sa, Sb and Sc arearranged in the image pickup region S, thereby the image processingsection 14 determines which direction the living body 2 is placed on thebasis of the pixel values Ra, Rb and Rc of the regions Sa, Sb and Sc. Inthis case, the direction where the living body 2 is placed in positiondetection is different from that in authentication, thereby which onebetween the position detection function and the authentication functionto be executed is determined by a change in the direction where theliving body 2 is placed. Moreover, the outputs of the light sources 50are changed (set) to an optimum output for position detection or forauthentication by a change in the direction where the living body 2 isplaced. Necessary light amounts for position detection andauthentication are different from each other, so when the outputs of thelight sources 50 are changed depending on a function to be executed, theamount of wasted light is eliminated to achieve power savings.Therefore, the biometrics authentication system 7 is specificallysuitable as a module mounted in an apparatus strongly demanding powersavings such as a cellular phone or low-profile notebook computer.

Modification 4

FIG. 18 is a schematic view of a biometrics authentication system (abiometrics authentication system 8) according to a modification(Modification 4) of the third embodiment viewed from above (from thecover glass 11 side). The biometrics authentication system 8 includeslight sources 50 on both sides of the cover glass 11, and photosensors51 are arranged outside the light sources 50 (farther from the imagepickup region S than the light sources 50). As the photosensor 51, forexample, a single light-sensing device, a photoreflector detectingapproach of the living body 2 from a height direction by closelyarranging a light-emitting device and a light-sensing device, or thelike is used. As in the case of the third embodiment, the biometricsauthentication system 8 includes the microlens array 12, thelight-sensing device 13, the image processing section 14, theauthentication section 15, the position detection section 16, the lightsource driving section 181, the light-sensing device driving section 182and the control section 19 (all not illustrated). Therefore, likecomponents are denoted by like numerals as of the third embodiment andwill not be further described.

As in the case of the third embodiment, in the modification, thespecific regions Sa, Sb and Sc are arranged in the image pickup regionS. Moreover, the light-sensing device driving section 182 drives thelight-sensing device 13 to selectively obtain pixel data in the regionsSa, Sb and Sc, and the image processing section 14 determines a functionto be executed. Further, in the case where the living body 2 is placedas illustrated in FIG. 19A, the image processing section 14 determinesto execute the position detection function, and in the case where theliving body 2 is placed as illustrated in FIG. 19B, the image processingsection 14 determines to execute the authentication function.

However, the modification is distinguished from the third embodiment bythe fact that when determining a function to be executed, outputs fromthe photosensors 51 are used instead of the pixel values Ra, Rb and Rcin the regions Sa, Sb and Sc. More specifically, in the modification, aswill be described below, function determination is performed, and thelight source outputs are changed. That is, as illustrated in FIG. 20,first, the light source driving section 181 turns the light sources 50on (step S21). At this time, the light emission amount of the lightsources 50 is set to the light amount a1 for position detection. Outputvalues Fa and Fb of the photosensors 51 on the basis of the light amounta1 are compared to a predetermined threshold value II (step S22). As aresult, in the case where both of the output values Fa and Fb are equalto or larger than the threshold value II (step S22: Y), the living body2 is considered to be placed as illustrated in FIG. 19B, and the imageprocessing section 14 determines to execute the authentication function.On the other hand, in the case where one or both of the output values Faand Fb are smaller than the threshold value II (step S22: N), the livingbody 2 is considered to be placed, for example, as illustrated in FIG.19B, and the image processing section 14 determines to execute theposition detection function. The determination results are outputted tothe control section 19 as the determination result data D_(M).

In the case where the image processing section 14 determines to executethe authentication function, as in the case of the third embodiment, theoutputs of the light sources 50 are changed from the light amount a1 forposition detection to the light amount a2 for authentication (step S23).Moreover, the image processing section 14 produces the image processingdata D1 on the basis of the light amount a2, and outputs the imageprocessing data D1 to the authentication section 15. The authenticationsection 15 determines whether or not authentication is executable on thebasis of the image processing data D1 (step S24), and the outputs of thelight sources 50 are maintained at the light amount a2 untilauthentication is properly completed (step S24: Y). In the case whereauthentication is properly completed (step S24: N), authenticationoperation in the authentication section 15 is terminated, and then theprocedure in the biometrics authentications system 8 goes back to thestep S21. The authentication result is outputted to outside asauthentication result Dout1.

In the case where the image processing section 14 determines to executethe position detection function, as in the case of the third embodiment,the light detection data is obtained while maintaining the outputs (thelight amount a1) of the light sources 50. The image processing section14 produces the image processing data D2 on the basis of the lightamount a1, and outputs the image processing data D2 to the positiondetection section 16. The position detection section 16 detects theposition (x, y, z) of the living body 2 on the basis of the imageprocessing data D2. Next, the pixel values Ra, Rb and Rc in the regionsSa, Sb and Sc are calculated to determine whether or not the pixelvalues Ra, Rb and Rc are changed in a certain period (step S25). In thecase where they are changed (step S25: N), the procedure goes back tothe step S21. In the case where the pixel values Ra, Rb and Rc are notchanged (step S25: Y), the light source driving section 181 turns thelight sources 50 off to complete the position detection process.Information on the position (x, y, z) is outputted to outside as theposition data Dout2.

As described above, in Modification 4, the photosensors 51 areseparately arranged outside the image pickup region S, thereby whichdirection where the living body 2 is placed is determined on the basisof the output values Fa and Fb from the photosensors 51. Therefore, asin the case of the third embodiment, which one between the positiondetection function and the authentication function to be executed isdetermined. Moreover, the outputs of the light sources 50 are changed(set) to an optimum output for each function so as to execute thefunction, so power savings are achieved. Therefore, the same effects asthose in the third embodiment are obtained. Moreover, when such sensorsspecifically for function determination are arranged in such a manner,determination is performed more accurately.

In addition, in Modification 4, the configuration in which twophotosensors 51 are arranged outside the light sources 50 is describedas an example. However, one or more photosensors may be arranged on onlyone side. Moreover, in function determination, in addition to the outputvalues from the photosensors 51, the pixel values Ra, Rb and Rc may beused.

Modification 5

FIG. 21 illustrates a schematic configuration of a cellular phone 9including a biometrics authentication system (a biometricsauthentication system 9A) according to a modification (Modification 5)of the third embodiment. As in the case of the cellular phone 3according to Application Example 1, the cellular phone 9 includes aflip-type enclosure (the first enclosure 20 and the second enclosure21), and the display panel 22 for displaying an image is arranged in thefirst enclosure 20. The second enclosure 21 includes the operationsection 23 and the biometrics authentication system 9A. The biometricsauthentication system 9A is mounted in the cellular phone 9 so that thetop surface (the cover glass 11) thereof is exposed to a surface of thesecond enclosure 21, and functions as a touch pad.

The biometrics authentication system 9A includes the light sources 50 onboth sides of the cover glass 11, and as in the case of the thirdembodiment, the biometrics authentication system 9A includes themicrolens array 12, the light-sensing device 13, the image processingsection 14, the authentication section 15, the position detectionsection 16, the light source driving section 181, the light-sensingdevice driving section 182 and the control section 19 (all notillustrated). Therefore, like components are denoted by like numerals asof the third embodiment and will not be further described.

Also in the modification, as in the case of the third embodiment, thespecific regions Sa, Sb and Sc are arranged in the image pickup regionS. Moreover, the light-sensing device driving section 182 drives thelight-sensing device 13 to selectively obtain pixel data in the regionsSa, Sb and Sc.

However, the modification is distinguished from the third embodiment bythe fact that a function to be executed is not determined by theplacement of the living body 2, but the function to be executed isarbitrarily set by a command from outside, for example, a selectionsignal from a user. The light source driving section 181 changes theoutputs of the light sources 50 depending on a function selected by theuser. More specifically, as will be described below, a function to beexecuted is selected, and the light source outputs are changed. That is,as illustrated in FIG. 22, first, the display panel 22 turns to an ONstate, and then an icon Ia for selecting the authentication function isdisplayed (step S31). Next, the light source driving section 181 turnsthe light sources 50 on (step S32). Under such a state, when the icon Iais selected (touched) by the user (step S33: Y), the authenticationfunction is executed. When the icon Ia is not selected (touched) by theuser (step S33: N), the position detection function is executed.

In the case where the authentication function is executed, as in thecase of the third embodiment, the outputs of the light sources 50 arechanged from the light amount a1 for position detection to the lightamount a2 for authentication (step S34). Moreover, the image processingsection 14 produces the image processing data D1 on the basis of thelight amount a2, and outputs the image processing data D1 to theauthentication section 15. The authentication section 15 determineswhether or not authentication is executable on the basis of the imageprocessing data D1 (step S35), and the outputs of the light sources 50are maintained at the light amount a2 until authentication is properlycompleted (step S35: Y). In the case where authentication is properlycompleted (step S35: N), the authentication operation in theauthentication section 15 is terminated, and the procedure in thebiometrics authentication system 9A goes back to the step S32. Theauthentication result is outputted to outside as the authenticationresult Dout1.

In the case where the position detection function is executed, as in thecase of the third embodiment, the light detection data is obtained whilemaintaining the outputs (the light amount a1) of the light sources 50.The image processing section 14 produces the image processing data D2 onthe basis of the light amount a1, and outputs the image processing dataD2 to the position detection section 16. The position detection section16 detects the position (x, y, z) of the living body 2 on the basis ofthe image processing data D2. Next, the pixel values Ra, Rb and Rc inthe regions Sa, Sb and Sc are calculated to determine whether or not thepixel values Ra, Rb and Rc are changed in a certain period (step S36),and in the case where they are changed (step S36;N), the procedure goesback to the step S32. In the case where the pixel values Ra, Rb and Rcare not changed (step S36: Y), the light source driving section 181turns the light sources 50 off to terminate the position detectionprocess. Information on the position (x, y, z) is outputted to outsideas the position data Dout2.

As described above, in Modification 5, for example, the icon Ia forselecting the authentication function is displayed on the display panel22, and the user selects a function to be executed by the icon Ia.Moreover, the outputs of the light sources 50 are changed (set) to anoptimum output for the selected function, so power savings are achieved.Therefore, the same effects as those in the third embodiment areobtained.

In addition, in Modification 5, as a means for selecting theauthentication function, the icon displayed on the display panel 22 isdescribed as an example. However, the selecting means is not limited tothe icon, and may be a button or a switch separately arranged in theoperation section 23 or the like.

Moreover, in the third embodiment and Modification 4, a function to beexecuted is determined on the basis of the direction where the livingbody 2 is placed. However, the invention is not limited thereto, and afunction to be executed may be determined on the basis of the movementof the living body 2 on the image pickup region S. For example, when afinger is dragged on the image pickup region S in a longitudinaldirection, the pixel values Ra, Rb and Rc are temporally changed.Therefore, determination that in the case where the finger moves asdescribed above, the authentication function is executed may beperformed by detecting a change in the pixel values Ra, Rb and Rc.

Moreover, in the third embodiment and Modifications 4 and 5, as anapplication example of the biometrics authentication system, the touchpad is described. However, the biometrics authentication system may beapplied to a touch panel with the display function described in thesecond embodiment.

Although the present invention is described referring to the embodimentsand the modifications, the invention is not limited thereto, and may bevariously modified. For example, in the above-described embodiments andthe like, in the image processing section 14, two right and leftparallax image data are produced on the basis of the light detectiondata D0, but the number of produced parallax image data is not limitedto two, and may be three or more. Moreover, the pixel data extractedfrom the light detection data D0 may be pixel data in any of the pixelsin the light-sensing region 12D of each microlens. However, it ispreferable to extract pixel data in pixels arranged in regions having aslong base-line lengths from the left direction and the right directionas possible, because as described above, on the basis of the correlationbetween parallax images, a phase difference between the phases of theliving body 2 in the parallax images is detected.

Moreover, in the above-described embodiments and the like, on the basisof the light detection data D0 obtained in the light-sensing device 13,the image processing section 14 produces the image processing data(parallax image data), and then inputs the image processing data to bothof the authentication section 15 and the position detection section 16.However, the above-described parallax image data may be inputted to atleast the position detection section 16. More specifically, the lightdetection data obtained in the light-sensing device 13 and not subjectedto image processing by the image processing section 14 may be directlyinputted to the authentication section 15, and authentication may beperformed on the basis of the image pickup pattern of the lightdetection data. Alternatively, the image processing section 14 mayperform only other image processing such as a noise reduction process onthe light detection data obtained in the light-sensing device, and theprocessed light detection data may be inputted to performauthentication.

Further, in the above-described embodiments and the like, an IR passfilter selectively allowing near-infrared light to pass therethrough maybe arranged on a light incident side of the light-sensing device, alight-sensing region or the light-sensing section. Thereby, the veinpattern of the picked-up image is obtained easily and accurately.

Moreover, light used for authentication is not necessarily near-infraredlight as long as at least authentication of veins is allowed to beperformed by applying the light to the inside of the living body 2. Inaddition, in vein authentication, an image of not only veins of afinger, but also veins of a palm or veins of fingers and palm may bepicked up to be used for authentication.

In the above-described embodiments and the like, as an example of thedisplay device, a liquid crystal device is described, However, any otherdisplay device, for example, a self-luminous device such as an organicor inorganic EL (Electro Luminescence) device may be used. However, inthe case where the self-luminous device is used, the backlight may notbe specifically arranged.

The present application contains subject matter related to thatdisclosed in Japanese Priority Patent Application JP 2008-200532 filedin the Japan Patent Office on Aug. 4, 2008, and Japanese Priority PatentApplication JP 2009-146189 filed in the Japan Patent Office on Jun. 19,2009, the entire content of which is hereby incorporated by references.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1. A biometrics authentication system comprising: a light sourceemitting light to an object; a microlens array section condensing lightfrom the object; a light-sensing device obtaining light detection dataof the object on the basis of the light condensed by the microlens arraysection; a position detection section detecting the position of theobject on the basis of the light detection data obtained in thelight-sensing device; and an authentication section, in the case wherethe object is a living body, performing authentication of the livingbody on the basis of the light detection data obtained in thelight-sensing device.
 2. The biometrics authentication system accordingto claim 1, further comprising: a light source driving section changingthe output of the light source depending on a function to be executedwhich is selected between a position detection function by the positiondetection section and an authentication function by the authenticationsection.
 3. The biometrics authentication system according to claim 2,wherein in the case where the position detection function is executed,the light source driving section sets the output of the light source toa first light source output, and in the case where the authenticationfunction is executed, the light source driving section sets the outputof the light source to a second light source output which is larger thanthe first light source output.
 4. The biometrics authentication systemaccording to claim 3, further comprising: a function determinationsection performing function determination of determining which onebetween the position detection function and the authentication functionto be executed.
 5. The biometrics authentication system according toclaim 4, wherein the function determination section performs thefunction determination on the basis of pixel data in a plurality ofregions of the light-sensing device, the plurality of regions beingdifferent from one another.
 6. The biometrics authentications systemaccording to claim 4, further comprising: one other light-sensing devicearranged outside a light-sensing region corresponding to thelight-sensing device, wherein the function determination sectionperforms the function determination on the basis of an output value fromthe other light-sensing device.
 7. The biometrics authentication systemaccording to claim 3, wherein one of the position detection function andthe authentication function is executed on the basis of a signalinputted by an external command.
 8. The biometrics authentication systemaccording to claim 1, further comprising: an image processing sectionperforming image processing on the basis of the light detection data,wherein the image processing section extracting pixel data in pixels atthe same position in image pickup regions of microlenses of themicrolens array section from the light detection data, and synthesizingthe pixel data, thereby to produce a plurality of parallax image data.9. The biometrics authentication system according to claim 8, whereinthe position detection section detects the position of the object on thebasis of a phase difference between the plurality of parallax imagedata.
 10. The biometrics authentication system according to claim 1,wherein the light source emits light in a near-infrared region.
 11. Thebiometrics authentication system according to claim 10, furthercomprising: one other light source emitting light in a visible region tothe object, wherein the light-sensing device obtains first lightdetection data on the basis of the light in the visible region by theother light source and second light detection data on the basis of thelight in the near-infrared region by the light source, and while theposition detection section detects the position of the object on thebasis of the first light detection data, the authentication sectionperforms authentication of the living body on the basis of the secondlight detection data.
 12. The biometrics authentication system accordingto claim 1, wherein the biometrics authentication system functions as atouch pad by which information is inputted in response to the positionof the object detected by the position detection section.
 13. Thebiometrics authentication system according to claim 1, furthercomprising: a display device in a plane where the light-sensing deviceis arranged, the display device emitting display light on the basis ofimage data for display.
 14. The biometrics authentication systemaccording to claim 13, wherein the light source is arranged below thelight-sensing device and the display device, and the display deviceemits the display light through the use of light from the light source.15. The biometrics authentication system according to claim 13, whereinthe biometrics authentication system functions as a touch panel whichdisplays an image, and by which information is inputted in response tothe position of the object detected by the position detection section.16. The biometrics authentication system according to claim 13, whereinthe light source emits light in a visible region and a near-infraredregion.